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ABSTRACT 



Since 1997, the Amsterdam Faculty of Education (EFA) has 
been officially recognized as a center for experimental teacher education. 
This paper describes the development of an assessment system and a World Wide 
Web-based portfolio system to help students take responsibility for their 
learning and their competence at three consecutive integrative assessments. 
The introduction provides background on the EFA and summarizes three ideas 
that provide the basis for the program: students need to be capable of 
managing change; students need to be given responsibility; and students have 
a considerable degree of freedom in filling out the details for their own 
learning processes. The central concept of meaningful learning is discussed 
in the second section, including authentic learning in professional education 
and the phases of the learning process (i.e., orientation, planning, 
execution, and evaluation) . The third section describes program facilities in 
relation to these learning processes. The following program facilities are 
presented in detail in the fourth section: (1) orientation (the role of 

competency descriptions and moments of integrative assessment) ; (2) planning 

(the role of contracts) ; (3) execution (learning practices and the role of 

resources and metawork) ; and (4) evaluation (the role of the portfolio) . 
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Abstract: Since 1997 Amsterdam Faculty of Education (EFA) has been officially recognized 
as a center for experimental teacher education. We describe the development of an assessment 
sy^em and a web-based portfolio system to help students take responsibility for their learning 
and then- proving conqietence at three consecutive integrative assessments. In this paper the 
new ^cept of curriculum for educating professional teachers is discussed. A new concept can 
only ^ ^ccessfiil in implementation if the assessment system is correspon dingl y altered. We 
also bnefly describe a web-based portfolio system that supports students in building proof of 
competence. A more elaborate description of that system is given in the documentation of the 
poster session "EFA's Digital Portfolio System'*. 



Introduction 
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The Am^dam Faculty of Education (EFA) provides for about 4000 students. Most of them study to 
become teacher on the elementary or the ^ondary level. In 1 997 the Dutch minister of Education reacted to a 
rather provocatve report of one of his advisory committees on the future of education in the Netherlands, and the 
W teach^ should be prepared for this. After a competition between several institutes for Teacher Education, 
]^A got the mmrstend appointment to traiBform into an ‘Erqierimental Teacher Education Program’. 

T^e basic toansform^on concepts are set in a constructivistic view on learning. The corresponding processes of 
c^ge m the mstitution and in the members of Faculty should mirror the intended processes of change that 
should occur in students on their way to professional con^ietence. 

The advisory committee report speaks about CARE for the present situation and COURAGE to envisage 
\^^t IS needed for the next century. In the next decade society will have gone into the information age, whilst 
^aton seems to be or^nized in the ways of the industrial age. The experimental Teacher Education is one of 
the courage-projects. It will be an experiment, so we don’t know 'Miere exactly we will end iqi That’s ■w4iy we 
call our endeavor 'expedition’ rather than ‘experiment’. This expedition is based on a few important ideas: 

Capable of managing change 

TeachCT Educatiem should adequately prepare students for their profession in a largely unknown future. We 
cannot predirt what that future will be like. However, v^iiat we do know is that in the decades to come there will 
be an mcreasmg demand for profwsionals who are capable of managing change and who can give form and 
sh^ to elation in the information society - not only because teachers must be able to react quickly to 
ch^ging circumstances m their teaching, but also because learning paths, in part due to rapid developments in 
informaton and communications technology, are becoming increasingly individualized 
Responsible 

The program should offer students an environment in wdiich they are indeed given the opportunity to shape 
their o\^ learning processes. For tlus, students need to be given responsibility and they need to accept it - 
respomibffity not only for the way in which they acquire the (constantly changing) competencies they will need 
m professional practice, but also for the way in which they demonstrate to the outside world that they have 
indeed acquired these con^ietencies. 

Freedom 

In this environment, students have a ccmiderable degree of fieedom in filling in the details of their own 
learning processes. Cto program operates in a context in which the requirements for newly qualified teachers are 
^pulated by law. This means that, although students should be given the opportunity to create their own 
leammg pa^ toward becoming adequately qualified, we wish students to demonstrate to us, through integrative 
inoments of assessment at three points in the program, that they have acquired the competencies they need to be 
admitted to the next phase. _ — x 



BEST COPY AVAILABLE 

2 

112 



national resources information 

CENTER (ERIC) 
is document has been 
:lived from the person or organization 

iginating it. 

inor changes have been made to 
iprove reproduction quality. 

... . 1 ^r-r^i Of OOllCV^ - — • ' 



This view runs directly counter to the view that, under the direction of the institution th^o£^ tiie 

roS Z a competent and qualified teacher consists of parts of a curnculum tot have ^ 

in advance, and tot evidence of competence is synonymous with the successful completion of those parts o 

curriculum. 

The central concept: Meaningful Learning 

“iTa'SS shodd create aa ctedomnete fb, «hi^ .ainora 

professional pracSes. Learning during the program must be linked as far as possible to useful and re^nsible 
work resembtog work in the profession for which one is being trained In profession^ practice, teach^ have to 
carry out relatively complex tasks tot fit in with the objectives of the school. To able to do this^fi^ork 
^ they must be able to use ‘two kinds of learning’. They should not only be able to on their o ^ 

initiativetiie knowledge and skills they need to do their job well Oeammg of the first kmd), but they shoidd alto 
be able to continue to learn from the experience gained and to experiment systematically with actions leadmg to 
improvement or change Oeaming of the second kind). 





Figure 1; congruence between work and education 
Both IfinHs of learning are important in the concept of ‘lifelong learning’. Both are guided by the 

competencies, which the compet^ and qualified teacher must have. ^ , j r 

The S^am should offer environments in which students can (and indeed should) J^ese tiro k^ of 

learning into practice connected to authentic practical work, m order to acquire the skills required for 

*’™ShTeaming process the student goes through in that environment, consists o^e phases of 

planning, executi^and evaluation, and is guided by the competocies den^jd ftom the 

For studOTts this means tot in their orientation with respect to the leammg^d workmg ^ 

competencies they need to kquire as their point of departure. In doing so, toy are av^ 

later^e, during the assessment, they will have to demonstrate that they have actiMy 

competencies. On the basis of that orientation, they formulate concrete Iram^ goals and ,, 

subsequently work on useful products in a learning environment created by the program (exwubon), and, y, 
thJ^Sate the degree to wSh those activities have contributed to the realization of their leammg goals and 

SSS^OTt rf^^SSs work is - if aU is well - based on the degree to wWch to tuber’s work has 
been useful in aiding to achievement of to school’s objectives, and on to teachCT s , 

improvements and to manage change. This assessment is therefore not bas^ on (h^nnected 

skms Since to program is intended to noirror professional practice. It includes at three ^mtsm toe an 

i^grative asses^!^StDmmg these assessments, students must show tot toy are qu^ed to to Mirt 
step^first to be admitted to to main phase, then to enter to assistant teacher phase, md, finally, they ^ 

towS toy are competent and qualified to start a professional career The student’s admission to e^h p^ 
depends on to outcome of these integrative moments of assessment, which aK m tot s^ ^ee 

During these integrative moments of assessment, students demonstrate mividually to a smaU 
(consisting of people within to institution and ftom outside) tot toy have reached a level of development 
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th the procedures followed in professional organizations and professional practice. 

Program facilities in relation to learning processes 

The program environment consists of a number of facilities which students use in taking resnonsibilitv for 
fte processes ^leai^g and gathering evidence of competence. Below, we demon^te in ^eral 

fte mle and toct^ played m the learning and/or working processes which studen; work tS wSg 
facies and ^ihtes yet to be developed. In the next section, this is worked out for ^ pSSiS^Sv 
Although reality is always more complex and ambiguous than schemes and pictures S sS e 




ExrcvtioD 

1 

Learning ces» M^woi^ 



Figure 2: program facilities in relation to lea rning processes 



Orientation 

»ch as ae consp^eni descripdons ^ 

Planning . 

Orientation, students translate the selected competencies into concrete learning goals thev 
^t to^hieve in a practice and they determine which sources in the fields of knowledge His and ^ 

infomarion are required for this. In this phase, students enter into a learning contract anla wmk c^nS fa 
^ helps students in formulating lean^g goals. 

fa ^s p^ st^te work and learn within the fiameworks agreed iqxin in the contact The learning 
uT ^ ^®ried out in the p^ession, souS^rt^^„ of 

^ Of «« second kisa, ^sea plaae b, „«ecdng Si. i<^3ro!SZi:g 

Evaluation 

buiS^ their growth in acquiring competencies (‘internal thermometer’) and work on 

^ ESffuo !s fae^atf ft of assessment (‘external thermometer’). For both 

aspects, the portfoho is the mam tool, fa this, metawork fiilfils a coaching, advising fimction 
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Program facilities in detail 

Orientation: The role of competency descriptions and moments of integrative assessment 

If students are to take responsibility in orienting themselves with respect to the competencies they need to 
acquire during the program or a particular phase of the program, a clear descnption mu^ be given of the 
competencies they can acquire demonstrably during the program. Competence descnptions are necessary both in 
relation to the ‘internal thermometer’ (self-assessment) and in relation to the ‘external thermometer’ (assessment 
by others), and they will therefore need to be described in two ways: 

1 For the internal thermometer: description in terms of long-tenn objectives, inchiding Actions such as becommg 

aware of the competence requirements, monitoring of growth and justification of choices made by students within 

the program facilities. • • • u ^ 

2. For the external thermometer: implementation of the above-mentioned long-term objectives m cnteria to be usea 
the three integrative moments of assessment for admission to the following phase of the program. Presently, 
we assume there will be three integrative moments of assessment during the fulltime program (con^tent for main 
phase, for Assistant Teacher phase, and qualified to start a career in the teaching profession). 

The integrative moments of assessment during the program are based i^n the competence descnptions; for 
this to be possible, for each competence, criteria must have been formulated which students have to me^ before 
they can consider themselves ‘competent to undertake the main phase’, ‘competent to undertake the assistant 
teacher phase’ or ‘a competent and qualified teacher’. During the moment of assessment, students must 
demonstrate individually to a small co mmi ttee (consisting of people both fi-om within the m^tution and outside 
it) that they have developed at least to the required level and they must also show the committee how their 
growth process proceeded (‘lines of development’). Students are also required to show that for a few 
competencies they exceed the minimum requirements. 

The integrative assessments are being developed in a two-dimensional space (see figure 3). The parameters 
determine how much fi«edom a student will have in designing his or her own convincing way of proving 
competence, and which role the show-case fi*om the portfolio plays in that proof. The sequence of three 
assessments will follow the positions indicated by the skew arrow. 

In collecting the evidence, students make use of their portfolio to draw vq) a ‘show-case’, a kind of current 
curriculum vitae. They do that by making a selection of their own learning and working results, which they have 
compiled in their portfolio with the aim of complying with the criteria for competencies. 

In addition, the committee can employ a numbCT of st an d ar dized tools to assess students’ competencies. 




Figure 3: dimensions of moments of integrated assessment 



A prerequisite for the proper fimctioning of the integrative moment of assessment as an external thermometer 
is that the institution has established clearly formulated criteria for the competencies in such a way that students 
still have enou^ fieedom to formulate their learning goals themselves. 
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Planning: The role of contracts 

phase, studaits have to formulate their own learning goals and the activities they plan to 
ti, on^taton on the competencies they have to acquire. Students’ learning godLust be 

to tt? n <^esOT^om. Students should formulate their goals in such a way that Ly are related 

to the work they are pmg to do m the context of the learning practice. In doing so, students must also takVkto 
Sy’Sl^^S moments of assessment they must be able to demonstrate the competencies 

After studOTts have orirated themselves, they enter into a contiadt with the educator responsible for the 
eammg practice md w^ the commissioner. In the contract with the commissioner, the commissioner specifies 
the re^iirements the ^oduct or service must meet. In the contract with the educator, the student deteniSS the 

* V specifically - which concrete (and short-term) learning 

LT 1 ? 7 and the resources (knowledge, skills and information) they feel are necess^TSs 
p^se Students dso s^ify m the contract with the educator how they propose to show (or be tested) that they 

have md^ worked on these competencies and that they have achieved their learning goals ^ ^ 

ct. °P resources (knowledge and skills) are not tested as separate units. However 

^ish to Organize their 

evince, cer^ knowledge should not be tested on the basis of the product delivered, but directly 
to to help stodrats on toeir way, descriptions of certain learning goals may be givea Subsequently 
studOTts, m consultation with their mentors, must themselves locate these descriptions in their line of 
development toward c^petencies and place them in the context of the learning practice, to addition to the 
learni^gods provided, students may also formulate personal learning goals or choose to work with lea^g 
goals fiomlearmng practices carried out earlier. wuii. wim learmng 

Execution: Learning practices and the role of resources and metawork 

Stud^ts work to le^g practices. These practices are learning environments within which students are 
pereonaUy responsible for carrying out tasks that are usefiil to themselves and to others 
to leanmg p^tices, s^ts deliver products or services, preferably commissioned by institutions or people 
wh^U ^e ^ of the result and who therefore have an interest to the delivery of a usefiil product to^e 

pianmng phase, the responsibilities of those tovolvStotoe learning 
SSe will supervise » help to. 

Resoles refer to the knowledge, skills and information students feel they need to order to be able to do the 
^ m well, to of fhei, develop™.^ arfeii of 

f* ifetenmimig the reanuces mvolved. Resources aie therefore as 6r as possible o^red 
ependently of ©toator, place and tune, to the offermg, students’ various learning styles are taken into 

R ^ to instruction on^- 

■ T^Y^r toe resources more flexible, to principle, resources are demand- 

^ ®todents then still need to acquire basic subject 

knowledge and skills, which will allow them to ask for new resources. 

The metawork el^t h^ two functions for students, both of which faU under ‘learning of the second kind’: 
It provi^s a tool to help students acquire the metacognitive skills they need to prove during the 
mtegrative m^ents of assessment For this, use is explicitly made of students’ activities and 
expenences during lea rning practices; 

It offers stunts si^ervision and/or coaching to formulating learning goals and choosing leamtog 
l^c^ and peparmg for the presentation of the proof of their corrqietence to official bodies^* 
mtemto md ext^) durmg the mtegrative moments of assessment. This function provides important 
support damg the phases of onentation, planning and evaluatioa 

*?®^®®°.toe learning goals students formulate and the competencies they have to 

toward becoming cipetent 

Evaluation: The role of the portfolio 

Students ke^ a recorf of their leamtog processes to a digital web-based portfolio system that is currently being 
p^SlTSt courex, of urere™*. I. 
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It is a tool to help students become aware of the competencies involved in the teaching profession, helping 

them evaluate their own process of development and keep a record of It; ^ 

It is a tool to help students keep a record of their personal curriculum; studei^ record wbchlear^g 
practices they have worked on, which learning goals they had mtended to achieve, wbch pr^ts the w r 
resulted in and the assessments they received fixim commissioners, teachers and/or fellow students. 

It is a tool to help students compile a showcase or curriculum vitae of material they have collected to provide 
evidence to the assessment committee* 




Figure 4: portfolio system 



rhe nortfoho therefore has three roles; an educational tool for the development of metacognitive skills^ 

>ool for prrsoml ™lmn tool to build couriuciuB proof of courpetouco 

For the three integrative moments of assessment during the program. 

rhe portfoho plays the role of a ‘student tracking system’ in a dyn^c cumculuno. , . . . 

^ has chosen to have a digital portfoho in the form of an mdividual homesite for each student. There 

were a number of reasons leading to tMs decision: .,11 j 

- A digital portfoho makes it possible to order a great deal ofmatenalcl^y and ccrap y. 

- Thro^hyperhnks students can easily show the relationship between different parts of the portfoho 

and so demonstrate the coherence between different elements in the program. 

- Experience from other institutes also indicates that many students find it motivating to present 

themselves on their own web-site. , i _.. iL^, n’ rrr drill" With 

- In this way the portfoho contributes to the necessary development of future ^hers ICT skihs. With 

the latest software it is becoming progressively easier to make a web-site and also withm reach of 
Students who are not conqniter experts. 

- Through placing the portfoho on the intranet or internet it can become a ineans of commumcahon 

between tutors and students and among students themselves. j. , 

. Finally students can continue to develop their portfoho after finishing then stipes and can present 
themselves to future employers on their own homepage. In this way the portfoho becomes an 
instrument in life-long learning*. 

During the paper session at SITE the results of the development of the Integrated Asses™ts ^1 
be showa A more elaborate description of that system is given m the documentation of the poster 
session "EFA’s Digital Portfolio System". That poster session will show the actual system. 



BEST COPY AVAILABLE 




U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 
National Library of Education (NLE) 
Educational Resources Information Center (ERIC) 




NOTICE 

REPRODUCTION BASIS 



This document is covered by a signed “Reproduction Release 
(Blanket) form (on file within the ERIC system), encompassing all 
or classes of documents from its source organization and, therefore, 
does not require a “Specific Document” Release form. 




This document is Federally-funded, or carries its own permission to 
reproduce, or is otherwise in the public domain and, therefore, may 
be reproduced by ERIC without a signed Reproduction Release form 
(either “Specific Document” or “Blanket”). 




EFF-089 (9/97) 




